EQUIVARIANT MORSE INEQUALITIES AND APPLICATIONS 



WEN LU 

Abstract. In this paper, we prove equivariant Morse inequalities via Bismut-Lebeau's 
analytic localization techniques. As an application, we obtain Morse inequalities on 
compact manifold with nonempty boundary by applying equivariant Morse inequalities 
to the doubling manifold. 



1. Introduction 

In his influential work [15], Witten sketched analytic proofs of the degenerate Morse 
inequalities of Bott [I] for Morse functions whose critical submanifolds are nondegen- 
erate in the sense of Bott. Rigorous proofs were given by Bismut |2J, by using heat 
kernel methods, and later by Helffer and Sjostrand [10], by means of semiclassical anal- 
ysis. Braverman and Farber [6] provided another proof using the Witten deformation 
techniques suggested by Bismut [2]. 

Concerning the standard Morse inequalities (i.e., for Morse functions with isolated 
critical points), an analytic proof is given by Zhang [I7J Chap. 5], in the spirit of the 
analytic localization techniques developed by Bismut-Lebeau [H §8-9]. Moreover, [T7J 
Chap. 6] contains a complete proof of the isomorphism between the Thom-Smale complex 
and the Witten instanton complex. Following the ideas in [17], we give here a proof of 
degenerate Morse inequalities by similar techniques. 

Let us mention the related papers [6], [TJ [8] . In [6l[7], Braverman, Farber and Silantyev 
used Witten deformation techniques to study the Novikov number associated to closed 
differential 1-forms nondegenerate in the sense of Bott and Kirwan, respectively. In this 
way, they obtained Novikov-type inequalities associated to a closed differential 1-form. 
When the closed differential form is exact, these inequalities turn to Morse inequalities. 

In [8], Feng and Guo establish Nivokov's type inequalities associated to vector fields 
instead of closed differential forms under a natural assumption on the zero-set of the 
vector field. 

In this paper, we work out equivariant Morse-Bott inequalities along the lines of [IT] 
(cf. [3, §8-9]). Compared to [8], where Bismut-Lebeau's analytic localization techniques 
are applied along the lines of [17], we can choose the geometrical data near the singular 
points as simple as possible, due to the equivariant Morse's Lemma [H]. As an appli- 
cation, we get degenerate Morse inequalities for manifolds with nonempty boundary by 
passing to the doubling manifold. Thus, we extend the result from [16] to the most 
general situation. 

Let M be a smooth m-dimensional closed and connected manifold, and let G be a 
finite group acting smoothly on M. Let / : M — > R be a smooth G-invariant Morse-Bott 
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function j3]. This means that the critical points of / form a union of disjoint connected 
sub manifolds Yi , . . . , Y r > such that for every x G Yi the Hessian of / is nondegenerate on 
all subspaces of T X M intersecting T x Yi transversally. One verifies directly that the index 
of the Hessian of / is constant on any orbit G ■ Yi. Set {Bi, . . . , B r j = {G • Yx, . . . , G ■ 
Y r '}, r ^ r', where B\,...,B r are pointwise disjoint orbits. Then Bi is a G-invariant 
submanifold of M. For 1 ^ i ^ r, let n.j be the dimension of the submanifold Bi and 
be the index of the Hessian of / on Bi. 

Using the equivariant Morse's Lemma [H], we embed each critical submanifold Bi in a 
G-invariant tubular neighborhood {h,N~ © N^~) of Bi such that h equivariantly embeds 
N~ © into M. Moreover, there is an open G-invariant neighborhood Bi of Bi in 
N~ © N+ such that if Z = (Z~, Z+) e B h then 

\Z~\ 2 \Z + \ 2 

/ ° KZ-, z+) = c- l -^L+ 

where c denotes the value of the constant fundtion /|_B r The rank of is n~ , while 
that of is m — rii — n~ . Let o(N~) denote the orientation bundle of N~ . We call n~ 
the index of Bi in M. 

In the sequel, we will often omit the subscript % in B^n^nl ', i.e., n denotes the 
dimension of the critical submanifold B and n~ is the index. Denote by o(N~) the 
orientation bundle of iV~ over B. 

Let Wi,W2 be two finite-dimensional G- representations. A morphism between W\ 
and W2 is a linear map which is G-equivariant. Let HomciWi, W2) denote the set of all 
morphism between W\ and Wi. If E\,E2 are two finite-dimensional representations of 
G, then we say that 

(1.2) E 1 < E 2 

in the representation ring R(G) if for any irreducible representation V of G, the multi- 
plicity of V in E\ is smaller than the multiplicity of V in E2, equivalently, 

(1.3) dim Hom G (V, E t ) ^ dim Hom G (U, E 2 ). 

Denote by Q l (B, o(N~)) the space of smooth differential i-forms on B with values in 
o(N~). Set Sl(B, o(N~)) = 0" =o o(N~)). Let ci B denote the exterior differential on 
o(iV - )) induced by the flat connection V o(Ar_) on o(iV _ ). Denote by H*(B, o(N~)) 
the cohomology of the de Rham complex (p,(B, o(N~)), d B ^ . Let H'(M) denote the de 
Rham cohomology groups of M. 

The main result of this paper is as follows. 

Theorem 1.1. Let M be a smooth m- dimensional closed and connected manifold, and 
let G be a finite group acting smoothly on M. Let f : M — > R be a smooth G-invariant 
Morse-Bott function. Then we have for k — 0, 1, . . . , m, 



k r k 

(1.4) £(-l)*-'ff'(M) ^ E (-l) k ~ J H>- n >(B t ,o(Nr)). 
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in the sense of U.ty) . When k = m, the equality holds, 

m r m 

(1.5) » IK" 'H'(U) = E E (-ir^H^iB^oiNr)). 

3=0 i=l j= n - 



Let us explain Theorem 11.11 in more detail. Set 

r r 

(1.6) Fj = o(N-)), Qj = E dim H^(B t ,o(N7)). 

i=i i=\ 

Let {V a }a=i be the finite set of irreducible representations of G. As representation 
spaces of G, Fj and H J (M) have the following decompositions: 

lo lo 

(1.7) Fj = Hom G (y a , Fj) ® V a , /F(M) = Hom G (K a , iP(M)) <g> \/ Q . 
For k = 0,1, ... ,m, a = 1, ... Jo, set 

(1.8) d° = dim Hom G (^ a , Fj), 6? = dim Rom G (V a , H j (M)) 
Then (jl.4p is equivalent to 

k k 

(1.9) £(-i) fe -^ < £(-i) fc - J '^ 

i=o i=o 

and (11.51) is equivalent to: 

m m 

(1.10) E( _1 ) m " J6 i = E( _1 ) m ~ Jrf i- 

j=o i=o 

From the equivariant Morse inequalities (jl.9p and (11.101) . we will obtain the Morse 
inequalities for manifolds with nonempty boundary. This goes like follows. Let M be a 
smooth m-dimensional connected orientable manifold with nonempty boundary DM. Let 
/ : M — > M. be a smooth function which is a Morse-Bott function in the interior of M. Let 
f\dM be restriction of / to the boundary. We also assume the following condition. Let 
dM = AL U iV_ be a disjoint union of closed manifolds such that f(u, y) = \u 2 + f+(y) 
in a collar neighborhood AL x [0, 77) of AL, while f(u,y) = —\u 2 + f-(y) in a collar 
neighborhood AL x [0,rj) of AL, where /+ (resp. /_) is a Morse-Bott function on AL 
(resp. AL). This implies that f\dM is also a Morse-Bott function. 

Let AL = N a+ U N T+ and AL = A" a _ U A" r _ be disjoint union of closed manifolds. The 
subscripts "a" and "r" refer to absolute and relative boundary conditions, respectively. 
Set A" a = A" a+ U AL- , N r = N r+ U AL_ . The Riemannian metric is assumed to take the 
product form g™ = g TdM ® d 2 u in the collar neighborhood dM x [0, 77), where g T9M is 
a Riemannian metric on dM. 

Let {Bi] T i=l (resp. {S +ti } t i ^ 1 , resp. {S'_ i j}*~ 1 ) be the critical submanifolds of / in the 
interior of M (resp. of /+ on AL, resp. of /_ on AL). Set 

(i.n) s , a+ , i = s , +>i niv a , s r -,i = S- ti nN r . 
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Let o(N~) denote the orientation bundle of N~ over Bi as before. To simplify our 
notation, we denote by o(S a+t i) (resp. o(SV-,i)) the corresponding bundle over S a+i i 
(resp. o(SV-,i)) and by n~ +i (resp. n.~_J its index in N a (resp. N r ). Set 

t+ 

F a+J = (B H J ~ n -+^ (S a+ii , o(S a+ti )) , q a+:j = dim F a+J ; 

i=l 
t_ 

(1.12) F^j =0iF'-<-.*( i V 1 i,o(£r-,i)), ? r -j = dim F r _j. 

Denote by H'(M, N r ) the relative cohomology of M with respect to N r . 
Theorem 1.2. The following inequalities hold for k = 0, 1, . . . , m, 

k k 

(1.13) £(-l) fe -^-(M,iV r ) ^ ^(-l) fc -V„ 

i=o i=o 

u>/iere 

(1.14) (M, AT r ) = dim ^ (M, iV r ), ^ = % + q a+J + q r -, 3 -i . 
The equality holds for k = m. 

When f\dM = and the critical points of / in the interior of M are isolated and 
nondegenerate, Theorem 11.21 reduces to Theorem 1 in [16] . 

2. Equivariant Morse Inequalities 

This section is organized as follows. In Section 12. 1[ we calculate the kernel of the 
Witten Laplacian on Euclidean space. The results of this section will be applied to the 
fibres of the normal bundle of critical manifolds in M. In Section 12. 2\ a special metric 
on the total space N is constructed such that the critical manifolds are totally geodesic 
in N. In Section 12.31 we introduce the Witten deformation, the deformed de Rham 
operator Dt and state a crucial result (Proposition 12.31) concerning the lower part of the 
spectrum of Dt- Section [231 is devoted to the Taylor expansion of Dt near the critical 
manifolds. In Section 12.51 a decomposition of Dt is established. Various estimates are 
also briefly described there. Finally in Section 12.61 we prove Proposition 12.31 and then 
finish the proof of Theorem 11.11 

2.1. Some calculations on Euclidian space. In this section, we calculate the kernel 
of the Witten Laplacian on Euclidian space. The result of this section will be applied to 
the fibres of the normal bundle to B in M. 

Let V be an /-dimensional real vector space endowed with an Euclidean scalar product. 
Let V + ,V~ be two subspaces such that V = V~ © V + and dimV - = n~ . Let / G 
C°°(V, R) be defined as: 

(2.i) m = m- L Y-+ L 1 L , 

where Z~ = (Z 1 , . . . , Z n -), Z + = (Z n ~ + i, . . . , Z[), (Z~ , Z + ) denote the coordinate func- 
tions on V corresponding to the decomposition V = V" © V + . 
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Let Z = Yl l a =i Za^a be the radial vector field on V. There is a natural Euclidean 
scalar product on AV*. Let dvy(Z) be the volume form on V. Let S be the set of the 
square integrable sections of AV* over V. For Si,s 2 G S, set 



(2.2) (si,s 2 )= / (s 1 ,s 2 )Av*dv v (Z). 

Jv 

Let d be the exterior differential operator acting on the smooth section of AV*, and let 
5 be the formal adjoint of d with respect to the Euclidean product (12. 2p . 

Let C(V) be the Clifford algebra of V, i.e., the algebra generated over K by e G V 
and the commutation relations ee' + e'e = — 2(e, e') for e, e' G V. Let c(e),c(e) be the 
Clifford operators acting on AV* defined by 

(2.3) c(e) = e* A -z e , c(e) = e* A +z e , 

where e*A and i e are the standard notation for exterior and interior multiplication and 
e* denotes the dual of e with respect to the Euclidean scalar product on V. Then AV* 
is a Clifford module. If X, Y G V, one has 

c(X)c(Y)+c(Y)c(X) = -2(X,Y), 

(2.4) c(X)c(F) + c(y)c(X) = 2{X, Y), 

c(X)c(Y) + c(Y)c(X) = 0. 

If we denote by v the gradient of / with respect to the given Euclidean scalar product, 
then 



(2.5) v(Z) = -^2z a e a + ^ Z <* e a- 

a=l a=n~+l 

Let A be the standard Laplacian on V, i.e., 
Set 

(2.7) d T = e~ Tf d ■ e Tf , 5 T = e Tf 5 ■ e~ Tf . 

The deformed de Rham operator on the Euclidean space is defined by 

(2.8) D TtV = d T + S T = d + 5 + Tc(v). 

Let e 1 , . . . , e l be the dual basis of e%, . . . , e\. Then we have the following result [15], [T71 
Prop. 4.9]. 

Proposition 2.1. The kernel of D\ v is one- dimensional and is spanned by 

(2.9) /3 = exp(-^)e 1 A... A e n ~ . 
Moreover, all nonzero eigenvalues of D\ v are ^ 2T. 
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Proof. We recall the proof for the reader's convenience. For e £ V, let V e be the 
differential operator along the vector e. It is easy to calculate the square of Dt }V , 

i 

D\ v = A + T 2 \Z\ 2 + T c{e a )c(y ea v) 



(2.10) =(A + T 2 |Z| 2 -T/)+T^[l-c(e Q )c(e Q )]+T ^ [l + c{e a )c{e a )] 

a=l a=n~+l 



n 

= (A + T 2 \Z\ 2 -Tl) + 2T(Y,ie a e a A+ e Q A % 

a=l a=n~+l 

The operator 

(2.11) C T = A + T 2 \Z\ 2 -Tl 

is the harmonic oscillator operator on V. By Th. 1.5.1], (TTj Appendix E], we 
know that Ct is a positive elliptic operator with one- dimensional kernel generated by 
exp(— )• Moreover, the nonzero eigenvalues of Ct are all greater than 2T. It is also 
easy to verify that the linear operator 



(2.12) ^ lea e* A+ e a Az ea 

is positive and has one-dimensional kernel generated by e 1 A ... A e" . The proof of 
Proposition 12. II is complete. □ 

2.2. Local analysis near critical manifolds. Let B be an equivariant critical sub- 
manifold of the Morse-Bott function /. By equivariant Morse's Lemma [LU Lemma 4.1], 
we know that B possesses a G-invariant tubular neighborhood (h, N) such that: 

(1) iV is a G-vector bundle over B, which is endowed with G-invariant scalar prod- 
uct g N . Moreover N, which has rank m — n, splits into two orthogonal G-subbundles 
N = N~ © N + , where the rank of iV~ is n~ . 

(2) h equivariantly embeds iV into M. Moreover there is an open G-invariant neighbor- 
hood B of B in iV such that if Z = (Z~, Z+) £ B, then 

(2-13) /(MZ)) = c-^! + ^l 

where c denotes the value of the constant function 

In the sequel, we will identify N and h(N). Let tt be the projection N — >• B. We 
denote by o(N~) the orientation bundle of iV~. 

Let g TB be a G-invariant Riemannian metric on TB and V TjB be the Levi-Civita 
connection on TB which is then G-invariant. As Euclidean G-bundles, (N~,g N ) (resp. 
(N + , g N+ )) can be endowed with G-invariant Euclidean connections (resp. V^), 
where g N (resp. g N+ ) denotes the restriction of the scalar product g N to the subbundle 
N~ (resp. iV + ). We then have a natural Euclidean connection on N, i.e., 

(2.14) v JV = v JV "ev JV+ . 
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The Euclidean connection V w on N induce a splitting TN = T H N (BT V N of the tangent 
space of the total space N [TJ Prop. 1.20], where T H N is the horizontal part of TN with 
respect to the Euclidean connection V N . If X 6 TB, let X H denote the horizontal lift 
of X in T H N such that X H e T H N, n*X H = X. 

If y G N, then identifies Ty N with T n ^B. Moreover, Ty N and N can be 
naturally identified. In this way, Ty N and Ty N are both endowed with a scalar product. 
We can assume as well that they are orthogonal for the metric g TN which splits into 
g TN = 7r*(g TB ) © g N . Let V TAr be the Levi-Civita connection on N associated to the 
Riemannian metric g TN . 

Let TN\b be the restriction of the tangent bundle TN to B. Recall that N is identified 
with the bundle orthogonal to TB in TN\ B , i.e., TN\ B = TB © N. Let V TAr|s be the 
restriction of V TN to TN\b- 

Lemma 2.2. The following identity holds: 

(2.15) V™ |fl = V TB © V". 

Proof. The proof is straightforward and is left to the reader. □ 



2.3. The deformed de Rham operator. Let g™ be a G-invariant Riemannian metric 
on M which coincides with g TN in a neighborhood of B via the embedding h (this is 
always possible by a partition of unity argument). 

Let o(TM) be the orientation line bundle on M and let dvu be the density (or Rie- 
mannian volume form) on M. Note that we do not assume that M is oriented; thus 
dv M E C°°(M,A m (T*M) © o(TM)) (see pQ p. 29], p. 88]). Let E be the set of 
smooth sections of A(T*M) on M. For s\, S2 € E, set 

(2.16) (si,s 2 )= / (si,s 2 )(x)dv M (x). 

J M 

Let D M be the classical Dirac operator on M, i.e., D M = d + 5, where d is the exterior 
differential operator and 6 is the adjoint of d with respect to the metric (I2.16p . 
Set 

(2.17) d T = e~ Tf d ■ e Tf , 5 T = e Tf 5 ■ e~ Tf . 
The deformed de Rham operator Dt is defined by 

(2.18) D T = d T + 5 T = D M + Tc(Vf), 

where V/ is the gradient vector field of / with respect to the Riemannian metric g™ of 
M. We denote by (M) the smooth sections of j-forms of M. The next result describes 
the lower part of the spectrum of D\ for large T. It will be proved in Section 12.61 

Proposition 2.3. There exist Cq > 0,T > such that for T > T , the number of 
eigenvalues of D^\q3<m) ^ n [0j Co) equals qj. Moreover, the direct sura of eigenspaces of 
D\ with eigenvalues in [0, Cq) is a G-vector space. 
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2.4. Local expansion of the operator D T near the critical submanifold B. We 

first introduce a coordinate system on M near B. lfyEB,ZE N y , let y t = exp y (tZ),t G 
R be the geodesic in M with y — y, y — Z, where yo denotes dy t /dt evaluated at t — 0. 
For e > 0, set £> £ = {(y, Z) E N;y E B, \Z\ < e\. In the following we denote \Z\ n simply 

iJy 

by \Z\. Since B and M are compact, there exists sq > such that for < e < Eq, the 
map (y, Z) G iV — )■ exp y Z G M is a diffeomorphism from £> £ onto a tubular neighborhood 
W e of I? in M. From now on, we identify B e with U £ and use the notation x = (y, Z) 
instead of x = exp y Z. Finally, we identify y G B with (y, 0) G N. 

The symbols d^s and dvN are understood in the same manner as dvM- Let {fi,...,f n , 
ei, . . . , e/} be a local orthonormal frame of TN\b with {/i, . . . , /„} being an orthonormal 
frame for TB and {ei, . . . , ei} an orthonormal frame for N. By the definition of g™ , we 
know that e±, . . . , e\ are also orthonormal basis at the points (y, Z) on the total space 
N. It is clear that 

(2.19) dv N (y, Z) = dv B {y)dv Ny (Z). 

Take a > 0. Let E (resp. E a ) be the set of smooth sections of tc*(AT*M\b) on the 
total space of N (resp. of ir*(A(T*M)\ B ) over B a ). 
For si, s 2 G E have compact support, set 

(2.20) ( Sl ,s 2 )= f (f ( Sl ,s 2 )(y,Z)dv Ny (Z))dv B (y). 

J B V J Ny ' 

If s G E has compact support in £> eo , we will identify s with an element of E which 
has compact support in IA £0 . This identification is unitary with respect to the Euclidean 
product fl2TT6|) and fl2T20l) . 

The Levi-Civita connection V™ on TM induces a connection on A(T*M), which we 
denote by V A(T * M) . Let V A(T * M)|s be the restriction of V A(T * A/) to A(T*M)\ B . The con- 
nection V A(T * M)|s on k{T*M)\ B can be lift to a connection on the bundle n*(A(T* M)\ B ), 
which we denote by 7r *(v A ( T * M )l s ). 

Definition 2.4. Let D , D be the following operators acting on E: 

^ = E C (/,K(v A ™-) /f , 

(2.21) \ 

D N = J2c(e a )n*(W^^)e a . 

a=l 

One verifies directly that D H , D N is self-adjoint with respect to metric (12.201) . Indeed, 
D N is formally self-adjoint along the fibres of N, i.e., for si,S2 G E with compact 
supports, y G B, 

(2.22) / (D N Sl ,s 2 ){y,Z)dv Ny (Z)= ! (s u D N s 2 )(y, Z)dv Ny (Z). 

JNy JNy 

Using the identification (A(T*M))^ tZ ) with (A(T*M)) y by parallel transport along 
the geodesic t — > (y,tZ),t G [0, 1] with respect to the connection v A ^ T * M \ we can now 
consider the connection v A(T * M ) as a Euclidean connection on tc*(A(T*M)\b) over B £ . 
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Recall that the vector field v is defined as in (I2.5p . Set 

(2.23) D% = D N + Tc(v). 

Then we have the following analogue of [5J Lemma 2.4] , [31 Th. 8.18]. 
Theorem 2.5. The following asymptotic formula holds on E £0 as T — > +oo, 

(2.24) D T = D% + D H + 0(\Z\ 2 d N + \Z\ 2 d H + \Z\ + T|Z| 4 ), 

where d H and d N represent horizontal and vertical differential operators, respectively. 

Proof. We adapt the proof from [3], Th. 8.18], [H Lemma 2.3] and show how the proof 
simplifies in our case, due to the fact that B is now a totally geodesic submanifold of 
the total manifold N. For (y, Z) G B eo ,X G T y N, let X be the parallel transport of X 
with respect to the connection V™ along the geodesic t — > (y,tZ), t G [0, 1], i.e., 

(2.25) (V T z M X)(y,Z) = 0. 
Then e a (y, Z) = e a (y) and 

n I 

(2.26) D M = ^c( /j )Vf * M) + ^c(e a )Vtr M) - 

j=l a=l 

For 1 ^ j ^ n, set 

n l 11 

(2.27) f](y, Z) = f s {y) + E E c Uv) Z "h + E E + °d Z | 2 )> 

fe=l a=l /3=1 a=l 

where c^Ay), c^^y) are smooth functions of y. Using (I2.25j) and Lemma [2T2l we find 
that 

(2.28) fj(y, Z) = ff(y, Z) + 0(\Z\ 2 ). 
Set 

(2.29) T = V A(T * M) - 7r*(V A(T * A/)ls ). 

By Lemma [221 T y = 0. Combining fT2T26D . fl2T28|) and fT2~29]) . we get 

(2.30) D A/ = + D w + 0(\Z\ 2 d H + \Z\ 2 d N + \Z\). 
Set 

n I 

(2.31) V/(j/, Z) = E + E Z K> 

j=l a=l 

where 

(2.32) ^-(y, Z) = (fjf)(y, Z), v a (y, Z) = (ej)(y, Z). 
Using (I2.13p . we find that 

(2.33) v a (y, Z) = —Z a , if 1 ^ at ^ n~; v a (y, Z) = —Z a , if n~ + 1 ^ a ^ I. 
From fl2TT3D and fLT28l) . we have 

(2.34) ^(y,Z)=0(|Z| 4 ). 
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Substituting (123511 and (12T34)) into (l23Tj) . we get 

(2.35) Vf{y,Z) = v + 0{\Z\ A ). 

Now flgjgjj follow immediately from fl2~30|) and (12~35D . □ 

Note that .D^ is actually an elliptic operator acting fibrewise on 7r*(AiV*). We now for- 
malize Witten's description of the spectrum of D\ ([151 PP- 674-675]) for the equivariant 
case by using the argument of [T71 Prop. 4.9]. 

Theorem 2.6. For any y G B, the restriction of (D^) 2 to C°°(N y , AN*) is a positive 
operator with kernel generated by 

(2.36) 0y = exp(-^f-)e y , 

where 9 y is the volume form of N~ . Moreover, all the nonzero eigenvalues of (D^) 2 on 
C°°(Ny, AN*) are ^ 2T. 

Proof. Let be the positive Laplacian along the fibres of N. From (I2.23p . it is clear 
that on tt*(A(T*M)\ b ) = n*(AT*B) <g> AN*, 

(2.37) (^) 2 = - ^(tt* V™'-) 2 + T 2 |^| 2 + T ^ c(e^)c(^ V™'-^). 
By (12. 5p . we obtain that 

n~ I 

(2.38) (D?) 2 = A N + T 2 \Z\ 2 -Tj2c(e a )c(e a )+T £ c(e a )c(e a ). 

a=l a=n~+l 

Hence Theorem 12.61 follows from Proposition 12.11 □ 

2.5. Estimates of the components of as T — > +oo. In this section, we will 
give a decomposition of Dt = Y^j=i^T,j (see ( 12.491) ) and establish estimates of Dtj as 
T — > +oo by using Bismut-Lebeau analytic localization techniques [3J. 

We denote by det(iV - )* the determinant line bundle of (N~)*. The connection 
V N on N~ induces naturally an Euclidean connection ^/ det ( N )* on det(iV - )*. Let 
$ : det(iV - )* o(N~) denote the canonical isomorphism over B. Let V o(Af ) be 
the Euclidean connection on o(N~) induced by V det ^ '* via canonical isomorphism 
$ : det(iV-)* -» o(N-). 

For any \i > 0, let E M (resp. E M , resp. F M ) be the set of sections of A(T*M) on M 
(resp. of vr*(A(T*M)| B ) on the total space N, resp. of A(T*B) <g> o(N~) on B) which 
lies in the /i-th Sobolev spaces. Let || • || EM (resp. || • || M , resp. || • || pfl ) be the Sobolev 
norm on E M (resp. E M , resp. F M ). We will always assume that the norm || • || (resp. 
|| • || ) is the norm associated with the Euclidean product (12. 16)) (resp. (12.20)) ) . The 
norm || • || defined on the sections of A(T*B) £g> o(N~) is associated with a Euclidean 
product similarly to (12. 16)) . 

Take e G (0, y]. Let ip be a smooth function on K with values in [0, 1] such that 



(2.39) (p(a) 



1 ifa^|, 
ifa>l. 
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For y G B, Z G N y , set 

(2.40) p(Z) = V (^). 

For T > 0, set 



(2.41) a T (y) 



[ exp(-T\Z\ 2 )p 2 (Z)dv Ny (Z) 
Jn v 



Clearly, y i— > otx{y) is a constant function on B. Since for \Z\ ^ e/2, p(Z) = 1, there 
exist c > 0, C > such that for T ^ 1, 

(2-42) 7^<«t^ ( ' 



yV 2 ^/ 2 ' 

Here I = m — n denotes the rank of N. 

Definition 2.7. For p ^ 0, T > 0, define J T : F' 1 ->■ by 

(2.43) J TS ( 2/) Z) = ^p(Z)exp(-«) S ( 2 /)A^GE^, s G F A 



where the smooth section 9 of A™ (N~)* <g) o(N~) is given by 

(2.44) m 1 A ... A u n ~ <g) (^(u 1 A ... A u n ~) 
for any orthonormal basis {m j }" =1 of N~ . 

It is easy to see that Jt is an isometry from F° onto its image. 

For fx ^ 0, T > 0, let E T be the image of F M in E M by J T . Let E^ -1 be the orthogonal 
space to E° in E°, and let Pt-iPt be the orthogonal projection operators from E° on 
E^Ey -1 , respectively. 

Recall that A(T*M) is identified with tt* (A(T*M)\ b ) on B £0 ~ U E0 . Therefore if 
s G F M , we can also consider J^s as an element of E M . Let E^ be the image of F M in 
E M by Jt- In particular, E^ may be identified isometrically with E^. Let E T ^ be the 
orthogonal space to E^ in E°. Then E° splits orthogonally into 

(2.45) E° = E° T ®E T ^. 

Let Pt-.Pt be the orthogonal projection operators from E° on E T ,E T ^, respectively. 
Since E^ may be identified isometrically with E^, we find that 

(2.46) p T s = pxs, for any s G E° , supp(s) C B £0 . 
In particular, 

(2.47) p T J T s = p T J T s, for any s G F°. 
According to the decomposition (12.451) we set: 

D T1 = p T D T p T , D T2 = p T D T p^, 

( 2 - 48 ) -i -i -i 

D T ,3 = Pt d tPti d t,4 = p T D T p T . 

Then 

(2.49) D T = D Tjl + D T>2 + D T>3 + D TA . 
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We will now establish various estimates for the D T j's as T — > +00. We define a twisted 
de Rham operator 

n 

(2.50) D B = c(/i)Vf. : n(B, o(N~)) -+ Q(B, o(N~)), 

i=i 

where V s = V TB <S> 1 + 1 <E> V ^ The following Lemma is similar to [3] Th. 9.8] and 
[H Lemma 3.1] 

Proposition 2.8. As T — > +00 , the following formula holds 

(2.51) J T 1 D TA J T = D B + 0(^ f ), 

where 0{-^=) is a first order differential operator with smooth coefficients dominated by 

c/VT. 

Proof. We can proceed as in [31 Th. 9.8], [HI Lemma3.1]. The proof becomes easier 
because of the simpler local formula (12. 35ft of the gradient of /. By ( 12.24ft . 

(2.52) D T>1 = p T D T p T = p T (D H + + R T )p T , 
where 

(2.53) R T = 0(\Z\ 2 d H + \Z\ 2 d N + \Z\ + T\Zf). 
From ([236]), (|237ft and ([232]) . we find that 

(2.54) J T l D T +J T = J- 1 p T (D H + D% + R T )p T J T . 

We may write out the projection pt explicitly. From (12.4=311 . one verifies directly that for 
s e E°, 

p T s(y, Z) =—^—p(Z) exp(- 2H|£) 

(2.55) ^ V ; 

(s(y,Z'),9 y )p(Z')e W (-^)dv Ny (Z')A6 y . 



From (EUD and [1, Prop. 1.20], we find 

(2.56) V%Z = 0, V N 6 y = 0. 

For s e F 1 , (1236]) yields 

D H Jt s {jJi Z)=J2 c{fi)K*Vfr mB [-L p(Z) exp(- 3fl!) a (y) A fl„ 



i=i 



(2 ' 57) =-^p(z)ex P (- 23f£) £c(/>*(vg a (y)) 

V j=l 

=J TJ D B s(y). 



For s G F° 

(2.58) Z^J T s = t^exp(-^|L) S (y) Ac{Vp(Z))9 y , 
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where \s\ denotes the degree of s and Vp(Z) is calculated in the fiber direction, i.e., 

(2.59) Vp(Z) = J2(^p)(Z)e a . 

a=l 

From ( 12351) . (I23gj) and ( jXBJj) , we get that 

(2.60) p T D%p T J T s = 0. 

For the term containing R?, one verifies directly that when T ^ lj 6 K, s G E°, 

C 

( 2 - 61 ) IH Z MIe° < Ja IHIeo- 

Using fl233|) and fl23T]) . we find 

(2.62) j t 1 PTjRtPt j t = o(-^) , T^oo. 

Finally (j2"37jl . ( 12760]) and ( I2T62|) imply the conclusion of Proposition EU □ 
Set 

E% x = E"nE^. 

Similarly to the proof of Theorems 9.10, 9.11 and 9.14 from [31 §9], we also have the 
following results. 

Lemma 2.9. There exists To > 0, C\ > 0, C2 > such that for any T ^ To, s G 

E^ , Si G Ey, we have 



\D T .2S Ln ^ 



Ci 



(2 - 63) II^Hko <%mi*, 

VT 



||t>t,4s|| e o ^C 2 (||s|| e1 + Vt||s|| e0 ). 

2.6. Proof of (11.9ft and ( ll.lOj) . In the first part of this section, we prove Proposition 
12.31 and then (II. 9p and (ll.lOp . Let C G (0, 1] be a constant such that 

(2.64) Spec (D B ) n [-2y/Q>, 2^/(T } C {0}, 

where Spec (D s ) denotes the spectrum of the operator D B . 

Let £(E°) denote the space of all bounded linear operators from E° into itself. For 
A G £(E°) and T ^ 1, we write A as a matrix with respect to the splitting E° = E^©E^ 
in the form 

(2 ' 65 > A - (Z t 

Definition 2.10. For A G £(E°), P G £(F°), set 

4 

(2.66) d(A,P) = ^2\\A j \\ 1 +\\JT 1 A 1 J T -P\\ v 

3=2 

where the operator norm || ■ || is given by H^l^ = Tr[(A*A)5]. 
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Let F T ° be the direct sum of eigenspaces of D\ associated to the eigenvalues lying in 
[0, Co). Let P^° be the orthogonal projection operator from E° on F^! . Let Q be the 
orthogonal projection from F° to K = Ker D B . Similar to J3j (9.155)], we also have the 
following: 

Proposition 2.11. For T large enough, we have 
(2.67) d(P^\Q)^ ( 



T 

Proof of Proposition POl From (12.671) . we see that for T large enough, 

(2.68) dim F^ = dim K. 

Let Pj denote the orthogonal projection operator from E° onto the L 2 -completion space 
of fi J (M) with respect to the metric (12. 16[) . We need to show that when T is large 
enough, 

(2.69) dim Pj(F%°) = qj . 
By flSSD, we find that 

m m 

(2.70) dim P i ( F t°) < dim F t° = J2 q r 

3=0 j=0 

Also, we find that for any Sj G Fj, ||sj|| F o = 1) 

(2.71) \\PjPg Jts 3 - JTSi\\ E o ^ d{P°°, Q). 
Thus from (12.671) and (12.711) . we have for s G K, 

(2.72) IIPjP^Jts- J t s\L 11 " 



From ( 12 .72 p . one deduces that for sufficiently large T, 

(2.73) dim Pj(f£°) ^ qj . 

From ( I2.70p and ( I2.T3|) , we get ( I2.69|) . Since the action of G commutes with the deformed 
de Rham operator Dt, the eigenspaces of D\ with eigenvalues in [0, Co) are G-vector 
spaces. This completes the proof of Proposition 12.31 □ 

Let F t a denotes the qj- dimensional vector space generated by the eigenspaces of 
D 2 T \ nj(M) associated with the eigenvalues lying in [0, Co), j = 0, 1, . . . , m. Then G maps 
F^°. into itdelf. 

Recall that the isometric map J T : F° -> E° is defined by (E35D - We define the map 
ex '■ F° — > F^° by er = P^°Jt- We will prove that ex is a G-isomorphism from Fj onto 
its image when T is large enough. 

Lemma 2.12. There exists C > such that for any s G Fj, 

(2.74) ||(e T - Jr)s|| E o = 0{^)\\s\\ F<} as T +oo . 
In particular, er is an G-isomorphism from Fj onto F T °- . 
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Proof. It is clear that maps Fj into F r °- and 

(2.75) (e T -J T )s = p t Pt°JtS - J T s + p^P^ a J T s. 

By Proposition 12.1 1[ for any s € Fj, 

||(e T - J T ) S || E0 ^ || (P^.Jts - J T s\\ E o + || (if'VH 
(2-76) c „ „ 



E° 



Therefore, £t\fj is injective for T large enough. Moreover, 
(2.77) dim Fj = dim F%°. = qj. 



Thus eT is an isomorphism from Fj onto F T ^ . Since g N is G-invariant 

(2.78) \g~ l -z\ nN = \z\ nN , g-e = e. 



9 g -i. y ' '94 



From (I2.4ip we have ax{y) = ax{g 1 • y)- From (I2.43P and (12. 78 p . we find that for any 
8 E F°, 

(g ■ J T s) (y, Z) =g ■ (J T s)(g^ 1 ■ y, g' 1 ■ Z) 

1 T\g~ 1 ■ Z\ 2 N 

p(\g- 1 -Z\ nN )exp( r-^)* 



v / Mp 1 ■ v) 

(2.79) g-s{g- l -y)Ag-9 g -i 1f 



'9 



T\ 7\ 2 

==p(|Z| g ,)exp( - — ^Lj («? • s )(y) A ( 5 • 0), 



=^r(# • s) (y,Z). 

This shows that g commutes with J?. Since g commutes with Dt, g commutes with 
P T °. Therefore, is a G-map, i.e., it commutes with the action of G. The proof of 
Lemma I2.12I is complete. □ 

Proof of U.9\) and U.lty . As G-representation space, F T °- can be decomposed as: 

h 

(2.80) F?° = Rom G (V a , F%) ® 

a=l 

Then (Homc(^ a , F^ .), cLt) is a G-subcomplex of the complex (F^ ., dr). From ( 11. 8ft and 
Lemma I2.12[ we see that 

(2.81) dim Hom G (K Q , Fg°.) = d?. 

From the Hodge theorem for complexes of finite-dimensional vector spaces, we know that 
the j-th cohomology group of the complex (F^°. , dr) is isomorphic to Ker D^\ n3 ^ M y Thus 
the dimension of the j-th cohomology group associated to the complex (Homc(V ra , F^° ) , dr) 
is 6". Then the inequalities ( II. 9p and (ll.lOp hold by standard algebraic techniques [TTj 
Lemma 3.2.12]. This completes the proof of Theorem ll.il □ 
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3. An application of equivariant Morse inequalities 



In this Section, we apply the equivariant Morse inequalities to prove Theorem 11.21 
which is a generalization of [T6| Th. 1]. We first prove a crucial Lemma. 

Lemma 3.1. The following inequalities holds for k = 0, 1, . . . , m, 

k k 

(3.1) ]T(-l) fe -^(M, N + ) < £(-1) V 

3=0 j=0 

The equality holds in ( Iff. 1\) for k = m. 
Proof. Set 

(3.2) M X = M U N+ (-M), M 2 = M l IV (—Mi), 

where (— M), (—Mi) are copies of M and Mi, respectively, and N'_ is the boundary of 
Mi, i.e., N'_ = U (-AL). 

Denote by M + , M.~ the trivial and the nontrivial one-dimensional real ^-representation, 
respectively. It is well-known that, as ^-representation spaces, fP(M 2 ) and if- 7 (Mi) 
have the following decompositions: 

H j (M 2 ) = HHM x ) ■ M + © HHMu N'_) ■ MT, 

(3.3) 

H 3 (Mi) = E 3 (M) • R + © H J (M, N+) ■ Mr . 

Let T\ and r 2 be the flip maps of Mi and M 2 , respectively. Let e and g be the trivial and 
nontrivial element, respectively, in Z 2 , which can be viewed as a multiplication group, 
i.e., g 2 = e = e 2 . Then Z 2 x Z 2 acts naturally on M 2 by 

(3.4) (e,g) ■ x = n(x), (g, e) • x = r 2 (x), V x G M 2 . 

Let {W 7 "}^! be the set of non-isomorphic irreducible representations of Z 2 x Z 2 . As 
vector space, W 3 = M but (e,g) acts as Id on W 1 ,W 2 and acts as —Id on W 3 ,W 4 ] 
besides (g, e) acts as Id on W 1 , W 3 and acts as —Id on W 2 , W A . 

Recall that and are defined in (ll.8p . Using (13. 3p and the Poincare duality 
theorem for manifolds with boundary [131 Chap. 5, Prop. 9.12], we calculate directly, 

(3.5) b) = pj(M), b) = p m _j(M), b] = ftj(M, N+), b) = m ^(M, N + ). 

To clarify our statement, we replace the vector space Fj, F a+ j and F r _j by Fj(f), F a+ j(f) 
and F r -j(f), respectively. The Poincare duality theorem yields 

(3-6) F 3 {-f)^F m ^{f). 

By considering the Morse-Bott function — / instead of /, we obtain that 

d) = q m _j + dim R F r _ ,j-i(-f) + dim K F a+ ,j(-f), d 2 = q m -j + dim w F r j^-f); 

(3.7) 

d 3 = q m _j + dim M F a+J (-/), dtj = q m -j- 

Now we prove (13. 7\i as follows. For w G Fj(—f), let {w} be the real line generated by 
w. Set 

(3.8) W = {w} © {ti(w)} © {r 2 (w)} © {t x t 2 (w)}. 
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Then W is a 4-dimensional vector space spanned by {if}, (ri(w)j, (r 2 (w)} and {tit 2 («;)}. 
Note that Z 2 x Z 2 acts naturally on W, which can be rewritten as 

W = {w + T\{w) + T 2 (w) + T 2 T 1 (w)} © {w + Ti(w) - T 2 (w) - T 2 T 1 (w)} 

© [w - Ti(w) + t 2 (w) - T 2 Ti(w)) © [w - Ti(w) - t 2 (w) + r 2 Ti(u>) j. 

Moreover, the 1-dimensional Z 2 x Z 2 -space {w + Ti(w) + t 2 (w) + r 2 rx(w)} ^resp. {w + 
t 1 (w)-t 2 (w)-t 2 t 1 (w)}, resp. {w-Ti(w)+t 2 (w)-t 2 t 1 (w)}, resp. {w-t 1 (w)-t 2 (w) + 
t 2 ti(w)} j is isomorphic to VT 1 (resp W 2 , resp. W 3 , resp. PF 4 ) as Z 2 x Z 2 representation 
space. Thus as a Z 2 x Z 2 representation space, 

(3.10) w ~ w 1 © iy 2 © w 3 © iy 4 . 

For nondegenerate critical manifolds on the boundary, we have for w G F r -j-x(—f),w' G 
{w} © {t 2 (w)} = {w + t 2 (w)} © {w - t 2 (w)}; 

(3 ' U) {w'} © {nK)} = {w 1 + ti(w')} © {to' - n(w')}. 

From (I3.6p . (I3.10P and (13. lip , one get (13 .7p immediately. 

Applying the equivariant Morse inequalities (II .9p to a = 4, we deduce that 

k k 

(3.12) ^(-l^A^M, iV + ) < ^(-l) fc -^ m _ r 

i=o i=o 

From (I3.12p . one verifies directly that 

k k 

(3.13) ]T(-l) fc ^(M, iV + ) < £(-1)*-^. 

i=o i=o 

One verifies easily that the equality in ( 13. 131) holds when k = m. The proof of Lemma 
13.11 is complete. □ 

Proof of ^1.13\) . We now consider the Mayer- Vietories sequence (T2J PP- 185] associated 
with the triad (M, N+, N r+ ): 

(3.14) H j -\N a+ ) F J '(M, iV + ) -> H j (M, N r+ ) # J (iV a+ ) -+ . . . 
From (I3.14p and [HI Lemma 3.2.12], we get 

(3.15) ^(-l) fe ~%(iV a+ ) - ^{M,N r+ ) + Pj(M,N+)] = dim Im 5* 

3=0 

where ^ denotes the connecting morphism H k (N a+ ) — > H k+1 (M, N + ) in the long exact 
sequence (I3.14p . 

Next we consider the triad (M, iV n A^ r+ ): 

(3.16) . . . -> H j ~\N r _) ->■ H j (M, N r ) -> iF(M, iV r+ ) ->■ H j (N r _) -> . . . 
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From (I3.16P and jTU Lemma 3.2.12], we find that 



k 

>2 ■ 



(3.17) J2(-V k ~ j Nr +) ~ &'( M > N r) + Pi-iW r -j\ = dim Im 6* 

j=0 

where 5% denotes the morphism H k (M, N r+ ) — > H k {N r S) in the long exact sequence 
f l3~T6|) induced by the inclusion (JV r , N r+ ) (M,iV r+ ). 

From (1313)1 . (1315)1 and ( l3~TTj) . we get that for fc = 0, 1, . . . , m, 

k k 

(3.18) ^(-l)^-(M, N r ) < ^(-1)S> 

i=o i=o 

where 

(3.19) ^ = $ + f3,(N a+ ) + Pj-i{N r J). 

The equality holds in (" 13 . 18[) for k = m. 

We now directly apply the degenerate Morse inequalities [21 (2.101)] to the closed 
sub manifolds N a+ and iV r _ respectively: for ^ k ^ m — 1, 

(3.20) ^(-l)^(iV a+ ) < ^(-l)^g a+)i , ^(-l)^.(iV r _) ^ ^(-1)^, 

3=0 j=0 j=0 3=0 

with equality for k = m — 1. Note that 

(3.21) /3m(iVa+) = = g a+ , m , /3 m (A^ r _) = = g r _ m . 

Due to (I3T20D and (EOT!) , the equality in fl3T20l) holds also for k = m. 

Now H 1 . 1 3 1) follows from ( 13.181) and ( 13.201) . One verifies easily that the equality in 
(11.131) holds when k = m. This finishes the proof of Theorem II .21 □ 

Acknowledgements. The author would like to thank Professors Xiaonan Ma and 
George Marinescu for their kind advices. 



References 

[1] N. Berime, E. Getzler and M. Vergne, Heat kernels and Dirac operators, Grundlehren Text Editions, 

Springer- Verlag, Berline, 2004. 
[2] J.-M. Bismut, The Witten complex and the degenerate Morse inequalities, J. Differential Geom. 

23 (1986) 207-240. 

[3] J.-M. Bismut and G. Lebeau, Complex immersion and Quillen metrics, Inst. Hautes Etudes Sci. 

Publ. Math. 74 (1991) 1-297. 
[4] R. Bott, Nondegenerate critical manifolds, Ann. of Math. 60 (1954) 248-261. 

[5] R. Bott and L. Tu, Differential forms in algebraic topology, Graduate Texts in Mathematics, vol. 

82, Springer- Verlag, New York-Berlin, 1982. 
[6] M. Braverman and M. Farber, Novikov type inequalities for differential forms with non-isolated 

zeros, Math. Proc. Cambridge Philos. Soc. 122 (1997) 357-375. 
[7] M. Braverman and V. Silantyev, Kirwan-Novikov inequalities on a manifold with boundary, Tran. 

Amer. Math. Soc. 358 (2006) 3329-3361. 
[8] H. Feng and E. Guo, Novikov-type inequalities for vector fields with nonisolated zero points, Pacific 

J. of Math. 201 (2001) 107-120. 
[9] J. Glimm and A. Jaffe, Quantum Physics, Springer- Verlag, New York, 1987. 



EQUIVARIANT MORSE INEQUALITIES AND APPLICATIONS 



19 



[10] B. Helffer, J. Sjostrand, A proof of the Bott inequalities, in: M. Kashiwara, T. Kawai (Eds.), 
Algebraic Analysis, vol I, Academic Press, Boston, MA, 1988, pp. 171-183. 

[11] X. Ma and G. Marinescu, Holomorphic Morse Inequalities and Bergman Kernels, Progress in Math- 
ematics, vol. 254, Birkhauser Boston, Inc., Boston, MA, 2007. 

[12] W. Massey, Singular Homology Theory, Graduate Texts in Mathematics, vol. 70, Springer- Verlag, 
New York-Berlin, 1980. 

[13] M. E. Taylor, Partial Differential Equations: Basic Theory, Texts in Applied Mathematics, vol. 23, 

Springer- Verlag New York, Inc., New York, NY, 1996. 
[14] A. G. Wasserman, Equivariant differential topology, Topology 8 (1969) 127-150. 
[15] E. Witten, Supersymmetry and Morse theory, J. Differential Geom. 17 (1982) 661-692. 
[16] M. E. Zadeh, Morse inequalities for manifolds with boundary, J. Korean Math. Soc. 47 (2010) 

123-134. 

[17] W. Zhang, Lectures on Chern-Weil theory and Witten deformations, Nankai Tracts in Mathematics, 
vol. 4, World Scientific Publishing Co. Ptc. Ltd., River Edge, NJ, 2001. 

Mathematisches Institut, Universitat zu Koln, Weyertal 86-90, 50931 Koln, Germany 
E-mail address: wlu@matri.uni-koeln.de 



